No adjustments are needed for multiple comparisons.

نویسنده

  • K J Rothman
چکیده

Adjustments for making multiple comparisons in large bodies of data are recommended to avoid rejecting the null hypothesis too readily. Unfortunately, reducing the type I error for null associations increases the type II error for those associations that are not null. The theoretical basis for advocating a routine adjustment for multiple comparisons is the "universal null hypothesis" that "chance" serves as the first-order explanation for observed phenomena. This hypothesis undermines the basic premises of empirical research, which holds that nature follows regular laws that may be studied through observations. A policy of not making adjustments for multiple comparisons is preferable because it will lead to fewer errors of interpretation when the data under evaluation are not random numbers but actual observations on nature. Furthermore, scientists should not be so reluctant to explore leads that may turn out to be wrong that they penalize themselves by missing possibly important findings.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Empirical Bayes adjustments for multiple results in hypothesis-generating or surveillance studies.

Traditional methods of adjustment for multiple comparisons (e.g., Bonferroni adjustments) have fallen into disuse in epidemiological studies. However, alternative kinds of adjustment for data with multiple comparisons may sometimes be advisable. When a large number of comparisons are made, and when there is a high cost to investigating false positive leads, empirical or semi-Bayes adjustments m...

متن کامل

Why we (usually) don’t have to worry about multiple comparisons

Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error paradigm that underlies these corrections. Moreover we posit that the problem of multiple comparisons can disappear entirely when viewed from a hierarchical Bayesian perspective. We propose building multilevel models in th...

متن کامل

چگونه حجم نمونه را در شرایط خاص تخمین بزنیم ؟

In the previous paper, the basic concepts of sample size calculation were presented. This paper explores main post-calculation adjustments of the sample size calculation in special circumstances such as multiple group comparisons, unbalanced studies (with unequal number of subjects in different groups) sample size correction for missing data, and adjustment for finite population size. In additi...

متن کامل

A Note on Estimated Coefficients in Random Effects Probit Models

This note points out to applied researchers what adjustments are needed to the coefficient estimates in a random effects probit model in order to make valid comparisons in terms of coefficient estimates and marginal effects across different specifications. These adjustments are necessary because of the normalisation that is used by standard software in order to facilitate easy estimation of the...

متن کامل

Sample Size Growth with an Increasing Number of Comparisons

An appropriate sample size is crucial for the success of many studies that involve a large number of comparisons. Sample size formulas for testing multiple hypotheses are provided in this paper. They can be used to determine the sample sizes required to provide adequate power while controlling familywise error rate or false discovery rate, to derive the growth rate of sample size with respect t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Epidemiology

دوره 1 1  شماره 

صفحات  -

تاریخ انتشار 1990